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ABSTRACT 



This paper discusses briefly the digital and analog synthesis of 
several optimum and quasi-optimum minimum-time controls for systems with 
real, null, and complex eigenvalues. Controls are designed using nonlinear 
feedback. Examples demonstrate the simplicity of the design. 

An example of the control of a nonlinear system is given using a 
technique which is effectively a linearization of the system about each 
state point on a trajectory. A quasi-optimum minimunrtime control is 
generated by substituting the nonlinear functions of the states for their 



respective linearized characteristics , 
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I INTRODUCTION 

The purpose of this paper is to demonstrate to the practicing engineer 
the simplicity of synthesis of several minimum-time controls. The emphasis 
herein is to move quickly from the theory in bang-bang controls to the task 
of generating the control functions in terms of the state variables or feed- 
back variables. 

The task is to design a physically constrained control which will drive 
the state vector from some initial condition to the origin of the state space 
in minimum time„ 

Simple controls using nonlinear feedback are demonstrated. In all of 
the examples shown, the problems were simulated on both digital and analog 
computers. One of the examples represented the control of a motor with a 
digital computer. 
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11 Mathematical Development 



Pontryagin's Maximum Principle [1 ] enables one to show that a 
minimum time control acts at its maximum effort whenever the measure- 
ment of the error is above the noise leveL 

The system to be considered may be described in general form as 

X = Fx + Du (1) 

or 

X = f(x , u) (1 ) 

We will restrict ourselves to linear systems with nonlinear sat- 
uration-type control. That is: F is a constant (n x n) matrix, x is an 
n-vector representing the error states of the system, D is a constant 
vector, and the control, u , is a scalar and is constrained (juj^N). 

From the Maximum Principle we see that u will operate at its max- 
imum values. This is easily seen by noting that u appears only linearly 
in the Hamiltonian: 

H = (maximum) (2) 

where the p^ are the adjoint variables given by 



V - 2 - 



( 3 ) 



rnt 

£ £ 

and the are the rows of (1)„ To obtain the maximum of H with respect 
to u requires that 

u = Nsgn (Ed^p^ (4) 

One may avoid the task of determining the adjoint variables by gener- 
ating the control as a function of the states. This then gives simply a feed- 
back control. 

A heuristic argument for generating these control functions follows. 

We have an initial value-final value extremal problem with a cost function 
and a set of differential equations of constraint. Starting at some initial 
state X (0) “ 0. / we desire to reach x (T) = 0_ in minimum time. If the 
solution to the differential equation is unique there are only two trajectories 
passing through the origin for the two values :1N of the control. If the 
differential equation is of second order, these two trajectories completely 
separate the space (phase plane for second order systems). If we can 
geometrically describe these trajectories in terms of the state variables 
we will have our control function [2,3]. This is best seen by examples. 



Ill Examples of synthesis of the control functions 



Example 1 . Two Null Roots 
Given: 





1 

0 


1 - 




0 


X = 






X + 






-0 


0- 




-1- 



u 



(5) 



and 



X (0) = c , X (T) = 0 



Find u such that 



Xj = / dt 



(minimum) 



( 6 ) 



where u is constrained, |u]^N. 
Solution: 

The Hamiltonian is 



H = PjX^ + p^u + P3 



The <|aximum of H minimizes (6). This is achieved with 
u = Nsgn p„ 



(7) 



( 8 ) 



The adjoint variable, , may be heuristically related to a negative time 
solution from the origin. Letting t= -t we have 



X 



1 




( 9 ) 



and 



X 



2 



= -Nt 



( 10 ) 



Eliminating the parameter r gives 

2 

_ 

^1 2N 



( 11 ) 



This is the equation for two parabolas with u = ±N. Of interest are 
those parts of the parabolas which are associated with trajectories coming 
into the origin in forward time. Accomplishing this in (11) and using the 
results as the equation of the control function gives 



u = 





( 12 ) 



This is indeed the optimum minimum time feedback control function and 
is readily simulated with analog or digital means. 

The system with optimum control is shown in familiar block diagram form 



in Fig. 1. Fig. 2 shows a typical optimum trajectory in the state space. 
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FIG. I BLOCK DIAGRAM OF 
SYSTEM WITH MINIMUM 
TIME FEEDBACK CONTROL. 




FIG. 2 OPTIMUM TRAJECTORY FOR 
S*X(S)- U(S) 

X|(0)«I.O, X2(0)'0, U«il 





Example 2 : A Null and a Real Root 



Given: 





-0 


1“ 




-0- 


X = 






X + 






-0 


-0£- 




-1- 



and 



X (0) = c , X (T) = 0 



( 13 ) 



Find u such that 




(minimum) 



where u is constrained juj^N. 

Solution: 

Referring to (7) and (8) which will be of the same form here, we shall 
move directly to the synthesis of the control function. It is useful to 
uncouple the state variables to simplify the geometry of our trajectories 
and to be able to treat the states in an orthogonal space. This is ac- 
complished by taking a partial fraction expansion on the transfer function 
describing each state with respect to the control and assigning a new state 
vector component, y^, to each eigenvalue, X. For example let 



X = Gy. 



(14) 



where 



u(s) 

^1 s(s+a) 



'll 



u(s) 

s 



+ 



'12 



uM 

s+a 



(15) 



and 



su(s) u(s) u(s) 

^2 = = ^21 s ^ ^22 s+a 



(16) 



giving 



G = 



rl/a 




-l/a- 
1 - 



and 



G 



-1 




1 -1 



1 J 



(17) 



(18) 



Let us solve the two uncoupled first order differential equations in 
negative time (t = -i). The first differential equation is 



y = -u 



(19) 







4 




which has the solution (for u = N) 



Yf = (O)-Nt 



( 20 ) 



Next the adjoint variable is used as an integrating factor to make the differ- 
ential equation exact. We have 



72 = ay2-u 



( 21 ) 



Multiplying by the adjoint. 



p(t) = p e 
o 



-OfT 



an(d cancelling gives 





-Of T 
u 



( 22 ) 



Integrating 



-OfT, 



e 




e u(T)dr 



( 23 ) 



or 



72 = 72(0)e 




- t) 



u (r)d T 



( 24 ) 



Note that we are considering u(i) to be constant over the interval. Finally 



we have (for u = N) 



( 25 ) 



tn\ , -iL/i 

Y2 a ® > 



The forward time solution for y is 



( \ _ ^2 N 

^2^®^ s+a s{s+a) 



(26) 



or 



72 (t) = 72(0)® + ~ ® ' 



(27) 



In negative time from the origin we have 



7 ^ = -N T 



(28) 



and 



N „ OCT. 

^2 = ® > 



(29) 



Again eliminating the parameter ^ we obtain the resulting control 



u = -Nsgn jy^ - — ^(sgn 72)ln(l + — ^ — ^2 l)] 



(30) 



The control function described in (30) is immediatel 7 read 7 for digital 
simulation. A two term approximation of the log function is taken for analog 



synthesis . 




FIO. 3 OPTIMUM TRAJECTORY FOR 
S(S^3.5) X (S)« U (S) 

X,(0)*I.O, Xt(0)>0, U=±l 
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«i m 







u 



(31) 



= -Nsgn [yj - V2 + ■i^y2l''2>] 



which in terms of the x variables is 



u = -Nsgn fx, + “~~x„ I x„ ll 
^ L 1 2N 2 ' 2 ' J 

Figure 3 shows a typical optimum trajectory in the state space. 



(32) 



Example 3: Two Real Roots 

Givens 





1 

r— 1 

o 

1 _ 




-0- 


X = 




X + 






-yjS -y-jS- 




-1- 



(33) 



and 



X (0) = c. , X (T) = ^ 

Find u such that 



r 

x^ = / dt (minimum) 



Where u is constrained, |u|^N. 



Solution; 



As before we will uncouple the system 



u(s) u(s) u(s) 

^1 (s+y)(s+jS) ^ll(s+y) ^12 (s+jS) 



( 34 ) 



and 



su(s) u(s) u(s) 

^2 ■ (s+y)(s+iS) " ^21 (s+y) ^22 (s+jS) 



(35) 



giving 



X = Gy. 



where 



G = 



jS- y y- j3 



—L 



y- /3 i3 - y 



(3 6) 



and 



G-' = 



/3 1 

y 1 



(37) 



The solution in negative time from the origin is 



and 





( 38 ) 



y 



2 




( 1 - e 




(39) 



By eliminating the parameter t , from (38) and (39) an expression for 
the control function is obtained. For the case of y<i3, this expression is 



u = -Nsgn ^;^(sgn y^) In (1 + ^-|yfj) - ^-(sgn y^) In (1 + ^- ly^ |)] (40) 

The control above is readily achieved by digital means . A quadratic ap- 
proximation to the log function is readily generated to give control by analog 
means. This is (for y<j3) 



r y 1 1 


• ^ 1 n 


Ul' 2N ^1 '^1 ' 


~ ^2^ 2N ^2 1^2 U 



which in terms of the x variables is 



(41) 



u = -Nsgn [0-y)x^ - '^( + x^) \^x^ + |+ ^(yx^ +^) lyx^ +^\] (41') 



It should be noted here that whenever the exact control function is approx- 
imated, the possibility of chatter motions exist. This is true for controls 
described in (31), (32), (41), and (49). The coefficient on the quadratic 
term may be adjusted to eliminate this [ 5 ] . 

In systems where the ratio of the real roots is an integer or nearly so, 
a simple optimum control may be generated. The equivalent of (38) and (39) 
expressed as function of time are 

T = -^ln (l+-^|yj|) (42) 

or 



V 

T= In il + -^\y^\) (43) 

and similarly 

fl N/i3 

r= In ( 1 + ~^ly 2 I) (44) 

Now let us use the arguments of the logarithms in (43) and (44) to obtain 
the control function. This is (for y<^) 

r ^ ft -1 

u = -Nsgn |^(sgn y^) (1 + -^|y^ I) - (sgn y^) (1 + ““|y 2 |) J (45) 



where /3/y is an integer or nearly so. Now simply use the binomial expansion 
in (45) to obtain 



u = -Nsgn { (sgn y^) [jy^ | + ^^1 ^ ' ' • ]"^2} 



(46) 



For example, let y= 1/2, )S = 1 . The optimum control which yields identical 
switching to the function given in (40) is 




Figure 4 shows an optimum trajectory using either (40) or (46'). 



(46') 



Example 4; Two Imaginary Roots 
Given; 









— — 
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1 


X + 


0 


2 








-to 


0 




1 










_ _ 



and 



X (0) 






= tC , 



X (T) = 0 



(47) 



Find u such that 
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■% 



I 



I 



I 




X2 




FIG. 4 OPTIMUM TRAJECTORY FOR 

(S+ I HS^O.5) X(S)« U(S) 
X,(0)-I.O, (0)-0, U-±l 



m- ^rif 



‘T 



X 



3 



dt 



(minimum) 



where u is constrained, |u|^N. 

Solution: 

It is noted that the zero trajectories are half circles with centers at 

( ' 0)* It can be shown [1,4] , that the optimum switching is a set of 

CO 

half circles arrayed along the x^- axis. The optimum control function may 
then be described with the aid of a fourier series as 



u 



r 2 

-Nsgn (sgn x^) 




(48) 



A simple and effective approximation for analog simulation is giv en by 



X j 2 

u = -Nsgn 1.016 (sgn x^) V |sin x^ 



(49) 



The system is described in Figure 5 , with typical trajectory using the above 
control function. 



Examples: Control of a second order nonlinear system (Van der Pol) . 
Given: 





“ 0 1 ^ 




1 

o 
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_-l (1 - x^^)_ 




_ 1 



u 



(50) 
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FIG. 5 OPTIMUM TRAJECTORY FOR 
(S*+l ) X(S)- U(S) 
X|(0)-I.O, X2(0)-0, U-±l 









Find u such that 



X3 = I dt 



(minimum) 



where u is constrained, |u |sN. 

Solution: 

The problem is analyzed by taking the solution to the linear problem 

[3], 





- 0 


1 “ 




0 “ 


• 

X = 






X + 






_-i 


-2t_ 




1 



u 



(51) 



and simply let 



c = 



1 

2 



o * 

( 1 - xp 



(52) 



For systems with complex roots the states are not completely uncoupled. 
However, a transformation's applied which places the real part of the 
roots on the main diagonal. Thus (51) is transformed with 



X = 



“ 1 




_ 0 


l/u _ 



(53) 



*Here x^^ denotes a weighted mean of its present and desired final states. 




t 



and 




C1 



X 



t'—l 



where 




giving 



~-r 


v~ 










z + 






-C- 




^ V . 



( 54 ) 



( 55 ) 



The negative time solution from the origin is 



y, = -1 + 



Ct 

e cos UT 



( 56 ) 



y 



2 




sin t'T 



( 57 ) 



for 



u = + 1 and 0<t'T<Tr. 



After eliminating the parameter t from (56) and (57), an expression 
for the control function is obtained in the neighborhood of the origin 
( |xj 1<1 + ot^, where , 



u = -sgn {(x^^ + ^Cx^x^ + x^)sgn x^ + 2(x^ + ^x^) + (e^-l)sgn x^j- 



( 58 ) 



where 



z = 2C arc cos 
V 



1 - (x^ + Cx2)sgn x^] 



rr- 



(59) 



2 2 
2(x^ + Cx2)sgn x^ + x^ + 2?x^x^ + x^ 



For |xj^ I ai + a , we may use a linear approximation to the optimum switch- 

f 

ing curve. This is simply 

u = -sgn [l/x^ + (x^ + fx^) + sgn x J (60) 

The control functions above were checked for various initial conditions 

with digital computer simulation. 

A quadratic approximation for the small signal control of (58) is 

; 

u = -sgn [2(x^ + CX 2 ) - x^ |x^ | - 2 fx^X 2 + ^2 ^ ^2 ^ 

A control of the form of (58) and (60) is demonstrated in Figure 6. Also 
a typical uncontrolled limit cycle is shown. 




FIG. 6 CONTROLLED AND 
UNCONTROLLED TRAJECTORIES 
FOR VAN DER POL EQUATION 



WITH U » i I 



r>f-< t 4i0hguz m_ 



J99 ^ m* 

M^v'nn# 



IV CONCLUSIONS 



It is hoped that this rather compact compilation of optimum and 
quasi-optimum minimum time control functions may be useful to the practicing 
engineer „ The results of control of a nonlinear system using linearization 
about each state point in a trajectory were reassuring to the doubtful. The 
solutions were all checked against true optimum trajectories by coming from 
the origin in negative time with the control satisfying the Hamiltonian (2). 
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